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FOR  ESTIMATING  PIECEWISE  CONSTANT  CONTROLS 
IN  DISCRETE  LINEAR  STOCHASTIC  SYSTEMS 


BY 

HAROLD  L.  STALFORD* 

ABSTRACT 


We  consider  discrete  linear  stochastic  processes  in  which 
the  control  variables  take  unknown  jumps  at  unknown  times  and 
remain  constant  between  jumps.,,  We  develop  a  Friedland-like  filtering 
technique  for  obtaining  the  optimum  estimates  x  of  the  state  and 

A  •' 

u  of  the  control: 

A.  —  ~  ~ 

x  »  x  +  Su  u  +  Sx  A  u 

A  ^ 

u  a  U  +  S.  Au 
Au 


where  x  is  the  control-free,  jump-free  estimate  of  the  state  x, 
u  is  the  jump-free  estimate  of  the  control  u  and  Au  is  the 
optimum  estimate  of  the  jump  Au  in  control.  The  matrix  Su  is  a 
function  of  the  x-filter  gain.  The  matrices  Sx  and  S  depend 
on  the  gains  of  both  the  x-and  the  u-filters. 


A  GLR  algorithm  is  presented  for  detecting  „  amp  time. 

It  consists  of  the  x-  and  the  u-filters  and  a  bank  of  Au-filters. 
A  procedure  is  developed  for  reinitializing  the  x-  and  the 
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u-filters  after  a  jump  has  been  detected.  After  reinitialization 

A  A 

the  optimum  estimates  x  and  u  are  functions  only  of  x  and  u, 
satisfying  Friedland's  expression.  The  reinitialization  procedure 
provides  the  tri-filter  technique  with  the  capability  to  handle 
multiple  jumps. 

^The  advent  of  the  tri-filter  technique  together  with  the 
reinitialization  procedure  makes  it  unnecessary  to  augment  the 
state  x  with  the  control  u  and  to  use  augmented  state  filters  in 
the  estimation  of  state  and  piecewise  constant  controls.  The  new  GLR 
algorithm  avoids,  therefore,  computational  problems  that  may  be 
associated  with  processing  large  matrices  in  augmented  state 
filters.  It  uses  only  unaugmented  state  filters  and,  consequently, 
it  has  particular  application  to  problems  involving  a  large  number 
of  state  and/or  jump  variables. 
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INTRODUCTION 


Techniques  for  the  detection  and  estimation  of  abrupt 
changes  in  discrete  linear  stochastic  systems  have  a  variety  of 
applications.  They  are  applicable  to  target  motion  analysis  and 
the  tracking  of  maneuvering  targets,  [1]  -  [5] .  In  aircraft 
control  they  are  used  for  the  detection  of  actuator  and  sensor 
failures,  e.g.,  [6]  and  [7].  In  electrocardiogram  analysis,  they 
are  used  to  detect  sudden  changes  in  the  rhythm  of  the  heart,  [8]. 
They  have  been  applied  to  the  problem  of  detecting  sudden  structure 
variations  in  the  Italian  power  system,  [9] .  A  survey  of  such 
techniques  are  given  in  [10]. 

The  generalized  likelihood  ratio  (GLR)  method,  [11]  and  [12] , 
is  one  of  the  most  attractive  and  promising  approaches  with  which 
to  develop  such  techniques.  The  GLR  method  provides  an  optimum 
decision  rule  for  detecting  and  estimating  abrupt  changes  (jumps) 
in  stochastic  systems.  Several  techniques  have  been  developed 
using  the  GLR  approach,  [1],  [1],  [13]  -  [18].  Willsky  and  Jones' 
GLR  technique  [16]  has  spurred  interest  in  reducing  the  compu¬ 
tational  requirements  of  the  GLR  approach  and  in  reducing  the 
computational  difficulties  associated  with  large  matrices.  Chang 
and  Dunn,  [17]  and  [18]  have  shown  that  the  requirement  for  matrix 
inversions  (or  for  solving  matrix  equations) in  GLR  techniques  such 
as  [16]  can  be  reduced  or  avoided  by  using  the  sequentially  updated 
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Kalman  filtering  technique  described  in  [19]  and  [20].  Stalford 

[1]  shows  that  further  reductions  in  computation  and  storage  are 
realized  by  using  a  decomposition  of  the  maneuver  signature  matrix 
(failure  signature  matrix  of  [10]  and  [16]). 

Herein,  we  are  interested  in  discrete  linear  control  (stochastic) 
processes  in  which  the  control  vector  takes  unknown  jumps  at 
unknown  times  and  remains  constant  between  jumps  (i.e.,  piecewise 
constant  controls) .  The  extension  of  the  work  contained  herein, 
to  the  case  of  a  time  varying  control  between  jumps  is  dealt  with 
in  a  future  report.  Chang  and  Dunn  [18]  have  treated  the  time 
varying  bias  jump  case  but  their  work  is  based  on  the  underlying 
assumptions:  (1)  the  jump  variable  is  zero  before  the  jump  and 

(2)  there  is  only  one  jump.  That  is,  in  [18]  the  vector  taking 
the  jump  has  no  influence  on  the  dynamics  of  the  state  before  the 
jump;  the  jump  vector  jumps  from  a  zero  state  as  far  as  the 
dynamics  of  the  system  is  concerned.  They,  in  essence,  treat  the 
case  of  an  unknown  time  varying  bias  which  appears  as  a  system 
input  at  some  unknown  time.  Since  we  address  the  case  of  multiple 
jumps  in  control  we  must  necessarily,  as  a  consequence,  treat 
jumps  in  control  that  jump  from  nonzero  values. 


It  is  a  common  practice  in  engineering  to  augment  the  state 
vector  by  adding  bias  terms  (such  as  the  control  variable  con¬ 
sidered  herein)  as  additional  state  variables.  We  call  the 
resulting  system  the  augmented  system  and  we  term  the  original 
system  the  unaugmented  system.  Augmenting  the  state  vector  with 
the  control  vector  may  be  undesirable  when  the  augmented  state 
vector  is  substantially  larger  in  dimension  than  that  of  the 
unaugmented  state  vector.  That  is,  the  additional  computations 
required  by  augmented  state  filtering  algorithms  may  become 
excessive.  Also,  numerical  inaccuracies  may  be  introduced  by 
computations  with  the  larger  vectors  and  matrices  of  augmented 
state  filters.  Friedland  [21]  and  [22]  investigated  the  problem 
of  estimating  the  state  x  of  a  linear  process  without  augmenting 
to  the  state  a  constant  but  unknown  bias  vector  b.  He  showed  that 

A 

the  optimum  estimate  x  of  the  state  could  be  expressed  as 

A  ^  A 

x  =  x  +  S  b 

where  x  and  b  are  computed  using  two  unaugmented  filters.  The 
estimate  x  is  the  bias-free  estimate,  computed  as  if  the  bias 

A 

were  zero.  The  estimate  b  is  the  optimum  estimate  of  the  bias  and 
it  is  the  output  of  a  filter  whose  state  vector  is  b.  The  matrix 
S  is  a  funtion  of  the  bias-free  gain  matrix.  Consequently, 
Friedland* s  filtering  technique  avoids  excessive  computations  and 
numerical  inaccuracies  resulting  from  augmented  state  filters. 
Tacker  and  Lee  [23]  extended  Friedland  filtering  to  the  case  of 
estimating  a  state  x  in  the  presence  of  a  time  varying  bias  b. 
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Chang  and  Dunn  [18]  essentially  investigated  the  same 
problem  as  that  considered  by  Friedland  [21]  and  Tacker  and  Lee 
[23]  but  with  the  one  difference  that  the  jump  time  is  unknown. 

That  is,  the  problem  considered  in  [21]  and  [23]  is  equivalent  to 
the  problem  of  estimating  a  jump  in  the  bias  vector  (from  a  zero 
value)  when  the  jump  time  is  known.  Chang  and  Dunn  assume  the 
jump  time  is  unknown.  They  apply  the  GLR  method  to  estimate  the 
jump  time  and  Friedland' s  filtering  technique  to  estimate  the  state 
x  and  the  time  varying  bias  b.  In  addition,  their  GLR  algorithm 
makes  use  of  the  sequentially  updated  Kalman  filtering  technique 
for  the  purpose  of  minimizing  the  computations. 

Herein,  we  develop  a  GLR  algorithm  for  the  problem  of 
estimating  the  state  x  in  the  presence  of  a  piecewise  constant 
control  variable  u  with  multiple  jumps  Au.  We  show  that  the 

A 

optimum  estimate  x  is  the  sum  of  the  outputs  of  three  unaugmented 
filters: 

x  -  x  +  Su  u  +  Sx  A~u 

where  x  is  the  control-free,  jump-free  estimate  (computed  as  if 
no  control  and  no  jump  were  presence),  u  is  the  jump-free  estimate 
of  the  control  (computed  as  if  the  no  jump  were  presence)  and 
Au  is  the  optimum  estimate  of  the  jump.  We  show  that  the  optimum 

A 

estimate  u  satisfies  the  expression 

A  ~ 

11  m  n  4*  ft  All 


The  matrix  Su  is  a  function  of  the  Kalman  gain  used  to  compute 
x.  The  matrices  Sx  and  S^u  are  functions  of  the  Kalman  gains 
used  to  compute  x  and  u.  The  GLR  method  is  used  to  detect  and 
estimate  the  jump  time. 

Multiple  jumps  are  handled  by  a  reinitialization  of  the  x 
and  u  filters  after  a  jump  has  been  detected  and  estimated.  After 
the  reinitialization  the  optimum  estimates  satisfy  Friedland's 
expressions  [21] : 

A  ^  I 

X  -  X  +  Su’  u 

A  ~  I 

u  =  u 

where  the  prime  indicates  the  quantities  after  reinitialization. 
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where  z  is  the  measurement  vector  and  h  is  the  measurement 
matrix. 
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The  noise  sequences  w  and  u  are  zero-mean,  independent. 


white  Gaussian  sequences  with  covariances  defined  by 


E  {w  (k)  wT(j)} 

=  Q(k)  6kj 

(4) 

E{u  (k)  uT(k)} 

=  R(k)  6kj 

(5) 

where  E{ •}  denotes  the  expectation  and  the  matrix  R(k)  is 
bounded  positive  definite.  The  initial  state  x(0)  is  normally 

A 

distributed  with  mean  x(0)  and  covariance  P^fO).  The  initial 

A 

control  u(0)  is  normally  distributed  with  mean  u(0)  and 
covariance  Pu(0).  The  cross  covariance  of  x(0)  and  u(0)  is 
denoted  by  P  (0) .  A  description  of  the  variables  and  their 

XU 

dimensions  are  given  in  Table  1 .  We  assume  that  the  linear 
system  (1)  -  (3)  is  observable. 

We  define  the  augmented  state  vector  X  as 
x(k) 

X(k)=  [  ]  (6) 

u  (k) 


The  augmented  system  is  given  by 

X (k+1)  =  *(k+l,k)  (X  (k)  +  4Xq  6gk)  +  Ta(k)w(k)  (7) 

z(k)  =  H  <k)  X (k)  +  u  (k)  (8) 

a 


TABLE  1 


gyom^M  VARIABLES  FOR  DISCRETE  LINEAR  STOCHASTIC 
WITH  CONTROL  JUMP:  UNAUGMENTED  SYSTEM 


VARIABLE 

x(k) 

A(k+l,k) 
B  (k+1 ,k) 
u(k) 

Au 

q 

r  (k) 

w(k) 

Q  (k) 
z  (k) 

H  (k) 
u  (k) 

R(k) 
x  (0) 

A 

u  (0) 
px(°) 

Pxu(0) 

Pu(0) 

Au(q) 

PAU«J» 


DEFINITION _ 

State  vector 

State  transition  matrix 

Input  control  matrix 

Control  vector 

Jump  in  control  at  time  q 

System  noise  coefficient  matrix 

Gaussian  white  system  noise 

System  noise  covariance  matrix 

Measurement  at  time  k 

Measurement  matrix 

Gaussian  white  measurement  noise 

Measurement  noise  covariance  matrix 

Mean  value  of  x(0) 

Mean  value  of  u(0) 

Covariance  of  x(0) 

Cross  covariance  of  x(0)  and  u(0) 
Covariance  of  u(0) 

Mean  value  of  fiu 

q 

Covariance  of  Au„ 

q 


SYSTEM 

DIMENSION 

nxl 

nxn 

nxp 

pxl 

pxl 

nxr 

rxl 

rxr 

mxl 

mxn 

mxl 

mxm 

nxl 

pxl 

nxn 

nxp 

pxp 

pxl 

pxp 


where 


A(k+1 ,k)  B (k+1 ,k) 

$  (k+l/k)  =  [  ]  (9) 

0  I 

AX  =  D  Au  (10) 

9  9 

0 

D  =  [  ]  (11) 

I 

H  (k)  =  [H(k)  0]  (12) 

a 


and  where  T  (k)  is  defined  as  the  augmented  matrix 

3 


ra(k) 


r(k) 

[  1 
o 


(13) 


The 

initial  mean 

value  and  covariance  are  given  by 

A 

A 

x(0) 

X(0) 

-  U  ] 

(14) 

u  (0) 

P  (0) 

P(0) 

=  [  X 

xu  ^ 

(15) 

PxuT<0) 

P  (0) 
u 

A  description  of  the  variables  and  their  dimensions  for 
the  augmented  system  are  given  in  Table  2. 
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TABLE  2 


SYSTEM  VARIABLES  FOR  THE  AUGMENTED  SYSTEM 


VARIABLE 

DEFINITION 

DIMENSION 

X(k) 

State  vector  (augmented) 

(n+p) xl 

$  (k+l,k) 

State  transition  matrix 

(n+p) x (n+p) 

ra<k) 

System  noise  coefficient  matrix 

(n+p) xr 

Q(k) 

System  noise  covariance  matrix 

rxr 

AX 

q 

Jump  in  state  at  time  q 

(n+p) xl 

z  (k) 

Measurement  at  time  k 

mxl 

Vk> 

Measurement  matrix 

mx (n+p) 

R  (k) 

Measurement  noise  covariance  matrix 

mxm 

w(k) 

Gaussian  white  system  noise 

rxl 

u(k) 

Gaussian  white  measurement  noise 

mxl 

X(0) 

Mean  value  of  X(0) 

(n+p) xl 

P(0) 

Covariance  of  X(0) 

(n+p) x (n+p) 

D 

Jump  coefficient  matrix 

(n+p) xp 

A> 

Jump  in  control  at  time  q 

pxl 

Au(q) 

Mean  value  of  Au_ 

q 

pxl 

PAu<*> 

Covariance  of  Au 

q 

pxp 
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We  let  Z ( j )  denote  the  sequence  of  measurements  from  time  1 
to  time  j: 

Z  ( j)  =  {  z (1)  ,  z (2)  ,  .  .  .  ,  z ( j)  } 


x. 


Our  problem  is  that  of  obtaining  the  optimum 
.  u,  AUg  and  q  without  using  augmented  state 


estimates  of 
filters. 
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3.  EQUIVALENT  FILTERING:  UNAUGMENTED  AND  AUGMENTED 

In  this  section  we  address  the  non jump  system: 

System  Dynamics 

x(k+l)  =  A(k+1 ,k)  x (k)  +  B(k+I,k)  u(k)  +  T(k)w(k)  (16) 

u  (k+1)  =  u  (k)  (17) 

Measurement  Equation 

z  (k)  -  H(k)  x  (k)  +  u(k)  (18) 

A  A 

We  are  given  the  initial  means  x(0)  and  u(0)  and  the  initial 
covariances  Px(0),  pxu(0)  and  Pu(0).  It  is  customary  to  augment 
the  state  x  with  the  control  vector  u  (the  control  u  serves  as  a 

bias  state  vector)  and  then  apply  the  Kalman-Bucy  filter  to  the 

/\ 

augmented  system.  One  obtains  the  optimal  estimates  X(k)  and 
P(k).  The  Kalman-Bucy  filter  equations  (24]  -  [28]  are  given 
in  Table  3  for  the  augmented  system.  The  filter  variables  are 
described  in  Table  4. 
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TABLE  3 


DISCRETE  KALMAN-BUCY  FILTER  EQUATIONS 
FOR  AUGMENTED  SYSTEM 


X(k+l,k)  =  $(k+l,k)  X (k)  (i)* 

P(k+l|k)  =  $ (k+1 ,k)  P  (k)  *T(k+l,k)  +  r  (k)Q(k)  r  T  (k)  (ii) 

Si  & 


Ya00 

=  z(k)  -  H  (k)  X(k|k-1) 

a 

(iii) 

va(k) 

*  H  (k)  P  (k|  k-1)  H  T(k)  +  R  (k) 

a  a 

<iv) 

K  (k) 

a 

=  P  (k|  k-l)  H  T(k)  V  _1(k) 

cl  d 

(v) 

X(k) 

=  X  (k  1  k-l)  +  K  (k)  Y  (k) 

a  a 

(vi) 

P  (k) 

=  [I-K  (k)  H  Ck)  ]  P(klk-l) 

a  a 

(vii) 

♦The^usual  notations  X  (k|  k)  and  P  (k|k)  have  been  shortened 
to  X (k)  and  P  (k) . 
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TABLE  4 

FILTER  VARIABLES  FOR  AUGMENTED  SYSTEM 


VARIABLE _ DEFINITION 


DIMENSION 


X(k) 

P  00 

X  (k+l|  k) 
P  (k+l|  k) 

T.W 

va(k) 

Ka(k) 


State  estimate  at  k  given  Z (k) 

Covariance  matrix  of  the  error 
in  X(k) 

State  estimate  at  k+1  given  Z (k) 

Covariance  matrix  of  the  error 
in  X (k+1 | k) 

Predicted  measurement  residual 
Covariance  of  y  (k) 

Filter  (Kalman)  gain  matrix  at  k 


(n+p) xl 
(n+p) x (n+p) 

(n+p)xl 
(n+p) x (n+p) 

mxl 

mxm 

(n+p) xm 
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Friedland  [21]  has  shown  that  it  is  unnecessary  to  augment 
the  state  vector  x  by  adding  additional  components  (e.g.,  bias 


vector  such  as  the  control  u)  in  order  to  obtain  the  optimal 

A  /V 

estimates  x  and  u.  He  showed  that  the  optimum  estimates  could 
be  obtained  by  employing  two  Kalman-Bucy  filters:  a  "bias-free" 
unaugmented  filter  and  a  bias  filter.  In  particular,  he  showed 

a 

that  the  optimum  estimate  x  of  the  state  could  be  expressed  as 

Am  A 

x  =  x  +  Su  where  x  is  the  output  of  the  "bias-free"  unaugmented 
filter  and  u  is  the  output  of  the  ?;  ■.<  .*  filter  and  where  the  matrix 
S  depends  only  on  matrices  whi<&  in  the  computation  of  x. 

In  that  work  Friedland  assumed  vV.  condition  that  there  is  no 
a  priori  correlation  between  the  state  x  and  the  bias  control 
vector  u,  i.e.,  pxu(0)  *  °«* 


The  purpose  of  this  section  is  to  show  that  Friedland' s 
unaugmented  filtering  technique  [21]  holds  for  the  case  when 
there  is  correlation  between  the  state  x  and  the  control  vector 
u,  i.e.. 


P 


xu 


(0)  *  0 


(19) 


He  make  the  following  definitions 


S0  -  pxu<01  Pu‘1,0)  <20> 

x0  -  x (0)  -  S0  u(0)  (21) 


*Ignagni  [29]  has  rederived  Friedland' s  two-stage  estimator 
in  which  he  assumed  at  the  outset  that  x  and  u  are  initially 
correlated  by  means  of  a  given  form.  He  show  here  that  it  is 
unnecessary  to  assume  the  given  form. 


V01  -  V°>  -  S0  V0)  S0T 

(22) 

—  ^ 
u0  =  u (0) 

(23) 

*Y 

Pu(0)  =  Pu(0) 

(24) 

In  view  of  (20)  -  (24)  the  initial  values 

A  A 

x  (0)  ,  u  (0)  and 

P(0)  have  the  form 

*  ~ 

x(0)  =  xQ  +  SQ  u0 

(25) 

u(0)  =  uQ 

(26) 

p(0,  .  (V°>  +  W”**  soV°>, 

(27) 

PU(0)S0T  Pu(0) 

We  call  the  above  form  the  Friedland  form. 

Friedland  [21] 

.  1 

showed  under  the  condition 

pxu(°)  -  o 

(28) 

A  A 

that  the  optimal  estimates  x(k),  u(k)  and  P(k) 

of  the  augmented 

'] 

system  satisfy 

A  ^  — 

J 

x(k)  ■  x(k)  +  S(k)  u(k) 

(29) 

A 

u  (k)  =  u(k) 

(30) 

] 

I 

[ 
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(31) 


P  00 


P  (k)  +  S  (k)  P  (k)  S  (k)  S(k)  P  (k) 

(  U  U  1 

Pu(k)  ST(k)  Pu(k) 


where  x(k),  Px(k)  and  S(k)  are  output  of  a  "bias-free" 
unaugmented  filter  and  where  u(k)  and  Py (k)  are  output  of  a 
bias  filter.  We  are  to  show  that  the  Friedland  form  (29)  -  (31) 
holds  under  condition  (19)  . 


We  treat  the  non-jump  system  (16)  -  (18)  as  a  jump  process 
at  time  zero  in  the  following  manner.  At  time  zero  before  the 
jump  we  assume  that  the  augmented  system  has  the  following  initial 
state,  mean  and  covariance 

x (0)  -  S.  u (0) 

XQ  -  [  0  ]  (32) 

v 


(33) 


Pv(0)  0 

P,  (0)  *  [  x  ] 

0  0 


(34) 


Eqs.  (32)  -  (34)  imply  that  the  control  u  is  known  to  be  zero 
before  the  jump. 


We  assume  that  a  jump  AXQ  occurs  at  time  (f 


state 


A  X.  =  [  ]  u (0) 

u  I 


where  u(0)  has  mean  Ug  and  covariance  Pu(0)  and 
of  xQ.  The  covariance  A P (0)  of  AXQ  is  given  by 

S0  V°>  soT  soV°> 

A  P  (0)  =  T  ] 

Pu(0)  S0  V0) 

The  mean  value  of  aXq  is 

*  ~ 

A  Xq  -  [ ^  ]  Uq 

From  Eqs.  (27) ,  (34)  and  (36)  we  note  that 
P  (0)  »  P1(0)  +  A  P  (0) 

From  Eqs.  (32)  and  (35)  we  observe  that 
x(0) 

X(0)  »  (  ]  =  X0  +  AX. 

u(0)  0  0 


in  the  augmented 


(35) 


is  independent 


(36) 


(37) 


(38) 


(39) 
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From  Eqs.  (21) ,  (33)  and  (37)  we  see  that 

A 

~  x (0)  * 

X(0)  =  [-  ]  =  Xft  +  AX-  (40) 

u (0)  u  u 

Eqs.  (38)  -  (40)  show  that  we  have  a  well-defined  jump 
process  at  time  zero.  Consequently,  we  can  employ  the  results 
of  [1]  which  applies  to  jumps  in  the  augmented  state  vector. 

For  this  purpose  consider  the  following  filtering  conditions 
for  the  Kalman-Bucy  filter: 

H1:  There  is  a  jump  in  state  and  control  but  the  filter  is 

unaware  that  the  jump  (35)  has  taken  place  and  it  operates 
as  if  the  jump  is  zero.  The  control  u(k)  is  assumed  to  be 
perfectly  known  as  a  zero  control.  The  initial  conditions 
(32)  -  (34)  are  used. 

H2:  There  is  a  jump  in  state  and  control,  the  jump  (35)  is 

known  to  the  filter  and  the  jump  information  is  made  use 
of  in  the  filter.  Before  the  jump,  the  control  u  is 
assumed  to  be  perfectly  known  as  zero  control.  The  initial 
conditons  are  (34) ,  (41)  and  (42) . 

x2(0)  =  xQ  +  SqU (0)  (41) 

A 

u2(0)  =  u  (0)  (42) 
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The  discrete  Kalman-Bucy  filter  equations  are  given  in  Tables  5 


and  6  for  Conditions  and  H2»  respectively.  The  Kalman  gains, 
the  state  covariances  and  the  predicted  measurement  covariance 
satisfy 

Kx(k)  =  K2(k)  (43) 

px<k)  =  P2(k)  (44) 

Px(k+l|  k)  =  P2(k+l|  k)  (45) 

vx(k)  =  V2(k)  (46) 

We  make  the  definitions 

AA(k+l,k)  =  [ I-K  (k+l)H(k+l) ]A(k+l,k)  (47) 

A  B (k+1 ,k)  =  [I-Kx(k+l)H(k+l) ]B(k+l,k)  (48) 

In  view  of  (43)  it  follows  from  Tables  5  and  6  that 

x1(k+l)  =  AA(k+l,k)  x1(k)  +  Kx (k+1) z (k+1)  (49) 

x2(k+l)  =  AA(k+l,k)x2(k)  +  AB (k+1 ,k) u (0) 

+  Kx (k+1) z (k+1)  (50) 


TABLE  5 


DISCRETE  KALMAN-BUCY  FILTER  EQUATIONS 
FOR  CONDITION  H 


x^k+llk)  =  A(k+l,k)x1  (k) 

P  (k+l|  k)  =  A(k+l,k)  P  (k)  AT(k+l,k)  +  T(k)  Q(k)rT(k) 

X  X 

Y  x  (k)  =  z(k)  -  H  (k)  xx(k|  k-1) 

V  (k)  =  H (k)  P  (k Ik-1) HT(k)  +  R(k) 

K  (k)  =  P  (k|k-l)  HT (k)  V  -1  (k) 

XX  X 

Xl(k)  =  Xl(k|k-1)  +  Kx(k)  Y1(k) 

Px(k)  =  [I  -  Kx(k)  H (k)  ]  Px(k|k-1) 


Az1(k)  =  z(k)  -  H  (k)  xx  (k) 

MW  MM 

x2 (0)  =  xQ 

V°>  »  Px(0)  -  S0  Pu(0)  S0T 


♦The^usual  notations  x..(kjk)  and  P  (k|k)  have  been  shortened 
to  x.  (k)  and  P  (k)  . 


TABLE  6 


DISCRETE  KALMAN-BUCY  FILTER  EQUATIONS* 
FOR  CONDITION  H2 


A  A 

x2(k+l|k)  =  A(k+l,k)  x2(k)  +  B(k+l,k)  u(k)  (i)  * 

P2(k+l|k)  =  A(k+l,k)  P2(k)  AT  (k+1  ,k)  +  T  (k)  Q(k)T  T(k)  (ii) 

A 

Y2(k)  =  z  (k)  -  H  (k)  x2  (k|  k— 1 )  (iii) 

V2(k)  =  H (k)  P2(k|k-1)  HT(k)  +  R (k)  (iv) 

K2(k)  =  P2(k|k-1)  HT(k)  V2_1(k)  (v) 

A  /y 

x2(k)  =  x2  (k |  k-1)  +  K2(k)  Y2(k)  (vi) 

P2(k)  =  [I  -  K2(k)  H(k) ]  P2(k|k-1)  (vii) 

Az2(k)  =  z(k)  -  H  (k)  x2(k)  (viii) 

x2(0)  =  xo  +  So  u(0)  (ix) 

P2(0)  =  Px(0)  -  SQ  Pu(0)  SqT  (x) 

u  (k)  =  u (0)  (Xi) 


♦The^usual  notations  x_(k|k)  and  P_(k|k)  have  been  shortened 
to  x2(k)  and  P2(k).  1  1 
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We  define  the  A-state  variable  A  ^ (k)  as 
A  (k)  =  x2  (k)  -  Xj^  (k) 

Subtracting  (49)  from  (50)  gives 

Ax1(k+1)  = A A(k+l,k)  A x1 (k)  +  A  B  (k+1  ,k)  u  (0) 

In  view  of  Eqs.  (41)  and  (51)  this  becomes 
A  x2 (0)  =  SQu (0) 

Ax1(k+1)  =  A  A(k+l,k)  A  xx  (k)  +  A B (k+1 ,k) u  (0) ,  k>0 
We  define  the  Su  matrix  as 

Su(k+1;0)  =  A  A(k+1  ,k)  Su(k;0)  +  AB(k+l,k),  k>0 

su(0;°)  =  SQ 

Consequently , A  x^ (k)  satisfies 
A  xx (k)  =  Su (k; 0)u(k) 


since  u(k)  =  u(0) 


The  measurement  equation  for  ix^  is  easily  derived.  We 
define  the  two  a  posteriori  measurement  residuals  for  Conditions 


Hx  and  H2j 


Az^k) 


A  z2  (k) 


=  z (k)  - 


H(k)  xx(k) 


=  z  (k) 


-  H  (k)  x2(k) 


(58) 

(59) 


Subtracting  (59)  from  (58)  gives  the  measurement  equation  for 
Ax, 


Az1 (k)  *  H(k)  Ax^k)  +  Au  ^  (k) 


(60) 


where 


Au  ±  (k)  -  A  z 2  (k) 


The  measurement  noise  Au  ^  (k)  is  a  zero-mean  white  Gaussian 
sequence  with  covariance  defined  by 


(61) 


{ Av^  (k)  Au  1i  (k)  }  =  Ru(k)  6  kj 


(62) 


where 


Ru(k)  *  R(k)  Vx_1(k)  R  (k) 


(63) 


We  have  made  use  of  Eq.  (46)  in  obtaining  (62) . 
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The  system  equations  for  u{k) 


are 


System  Dynamics 

u{k+l)  =  u(k)  ,  k>  0 

Measurement  Equation 

/^(k)  =  Hu(k)u(k)  +  Au  2(k) 

where 

Hu(k)  =  H (k)  Su(k;0) 

Eqs.  (57)  and  (60)  give  (65)  . 


The  Kalman-Bucy  filtering  equations  for  estimating  u(k) 
given  in  Table  7. 

In  view  of  (57)  the  augmented  AX(k)  is  given  by 


Ax.(k)  S  (k;0) 

A  X  (k)  «  [  1  ]  =  [  u  1  u(k) 


u(k) 


The  estimate  of  AX(k)  is 


.  S„ (k; 0) 

AX(k)  «  (  u  ]  u  (k) 

I 


(64) 


(65) 


(66) 


are 


(67) 


(68) 
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TABLE  7 

FILTERING  EQUATIONS  FOR  ESTIMATING  u(k) 


u(k+llk)  =  u  (k)  (i) 

Pu(k+l|k)  =  Pu(k)  (ii) 

Yu(k)  =  A~z1(k)  -  Hu(k)  u(k|  k-1)  (iii) 

Vu(k)  =  Hu(k)  Pu(kjk-1)  HuT(k)  +  Ru(k)  (iv) 

Ku(k)  =Pu(k|k-l)  HuT(k)  Vu_1(k)  (v) 

u(k)  =  u(k|k-l)  +  K,  (k)  y  (k)  (vi) 

Pu(k)  =  [I  -  Ku(k)  Hu(k)]  Pu(k|k-1)  (vii) 

where 

u(0)  =  u  (0)  (viii) 

Pu(0)  -  Pu(0)  (ix) 

Hu(k)  *=  H (k)  Su(k;0)  (x) 

Su(k+1;0)  =  AA(k+l,k)  Su(k;0)  +  AB(k+l,k)  (xi) 

<0; 0)  =  so  (xii) 

AA(k+l ,k)  -  [I  -  Kx(k+1)  H(k+1) ]  A(k+1 ,k)  (xiii) 

AB (k+I ,k)  -  [I  -  Kx(k+1)  H (k+1) ]  B(k+l,k)  (xiv) 

Ru(k)  «  R(k)  Vx-1(k)  R(k)  (xv) 

Azj  (k)  =  z(k)  -  H  (k)  x1(k)  (xvi) 


The  covariance  of  AX(k)  is 


S  (k;  0)  P  (k)  S  ,  (k;  0)  S  (k;0)  P  (k) 

A  p(k)  -  [  "  2  u  _u  u  ] 

P  (k)  Sui(k;0)  P  (k) 


where  u(k)  and  Pu(k)  are  given  by  the  filter  of  Table  7. 


In  view  of  Eqs.  (33)  and  (34)  and  the  filter  of  Table  5 
the  augmented  (k)  satisfies 


x1  (k) 

X,  (k)  =  [  1  ] 

x  0 


and  has  covariance 


P  (k)  0 

P,  (k)  =  [  x  ] 

x  0  0 


The  optimal  estimates  X(k)  and  P (k)  follow  from  the 
Kalman-Bucy  filter  of  Table  3  for  the  augmented  system: 


~  x  (k) 

X  (k)  =  U  ] 

u(k) 

P„(k) 

P 

P (k)  =  [  x 

XU 

PxuT<k) 

V] 
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It  is  shown  in  [1]  that  the  following  identities  hold: 


X  (k)  =  Xx(k)  +  AX  (k) 


P  (k)  =  P^k)  +  A  P  (k) 


Consequently,  Eqs.  (74)  and  (75)  verify  that  the  Friedland  form 
(29)  -  (31)  holds  under  the  condition  that  there  is  correlation 
initially  between  the  state  x  and  the  control  vector  u,  i.e., 
Eq.  (19)  holds. 


It  is  also  shown  in  [1]  that  the  gains  are  related  by  the 
expression 


Ka(k)  =  Kl(k)  +AK<k)  II  ”  Ha(k)  Kx  (k)  ] 


where 


K  (k) 

K.(k)  =  [  x  ] 
x  0 


S  (k;0)  K  (k) 
AK(k)  =  [  u  „  u  ] 

Ku(k) 


Eq.  (78)  follows  from  Eq.  (vi)  of  Table  7,  Eqs.  (57)  and  (67). 

Eq.  (77)  follows  from  Eq.  (70)  and  Eq.  (vi)  of  Table  5.  We  define 


Using  (76)  -  (78)  we  obtain 

K  (k)  =  K  (k)  +  S  (k;0)  K  (k)  [I  -  H(k)  K  (k)  ]  (80) 

X  X  u  u  X 

K  (k)  =  0  +  K  (k)  [I  -  H (k)  K  (k)  ]  (81) 

VI  U  X 

It  follows  from  Eqs.  (68)  -  (75)  that 

x (k)  -  xx(k)  +  Su(k;0)u(k)  (82) 

u(k)  =  u(k)  (83) 

px(k)  =  Px(k)  +  Su(k;0)  Pu(k)  SuT  (k;  0)  (84) 

Pxu<k)  =  Su(k;0)  Pu(k)  (85) 

Pu(k)  =  Pu(k)  (86) 

We  show  now  that  the  predicted  measurement  residual  covariances 
are  related  by 

V  (k)  =  V  (k)  R_1  (k)  V  (k)  R_1  (k)  V  (k)  (87) 

a.  X  u  x 

It  is  shown  in  [1]  that  the  augmented  matrices  Vfl(k),  (k)  and 
£V(k)  are  related  by 

Va(k)  =^i(k)  R-1<k>  AV(k)  R-1  (k)  Vx  (k)  (88) 

where 

4V(k)«  Ha(k)  A  P(k|  k-1)  HaT(k)  +R(k)  V1"1(k)  R(k)  (89) 

V^k)  *  Ha(k)  P1(k|k-1)  HaT(k)  +  R (k)  (90) 
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Since 

H  (k)  AP(k|k-l)H  T(k)  =  H  (k)  P  (k I k-1) H  T(k)  (91) 

cl  d  U  U 

H  (k)  P, (k|k-l)HT(k)  =  H(k)  Pv(k|k-l)HT(k) 
ala  x 


It  follows 

that 

V  (k) 

=  v.  (k) 

(92) 

X 

1 

vu(k) 

=  AV(k) 

(93) 

w 

i 


s 
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4. 


OPTIMAL  FILTERING  OF  UNAUGMENTED  JUMP  PROCESSES: 
REINITIALIZATION  AT  JUMP 


We  address  the  jump  process  described  by  Eqs.  (1)  -  (3) . 

A  jump  in  the  control  variable  occurs  at  time  q.  The  jump  Aug 
is  normally  distributed  with  mean  Au(q)  and  covariance  P^  u  (q)  • 
We  asstime  the  jump  is  independent  of  all  other  processes.  In 
this  section  we  assumed  that  the  jump  time  q  is  known.  We  use 
the  time  q  to  denote  the  time  before  the  jump  and  we  use  q+  to 
denote  the  time  just  after  the  jump. 

Before  the  jump  the  augmented  estimates  X(q)  and  P (q) 


satisfy 

x (q)  =  x^q)  +  Su(q;0)  u(q)  (94) 

u  (q)  =  u  (q)  (95) 

Px(q)  =  Px(q)  +  Su(q;0)  Pu(q)  SuT(q;0)  (96) 

Pxu(q)  =  su(q;0)  Pu(q)  (97) 

pu(q>  =Pu(q)  (98) 


After  the  jump  they  satisfy 

X(q+)  -  X(q)  +  AX (q)  (99) 

P(q+)  -  P(q)  +  AP (q) 


(100) 


where 


/f X  (q)  =  t  *  0  ]  (101) 

Au  (q) 

AP(q)  -  t  °  °  1  (102) 

0  PAu(q) 

Therefore,  after  the  jump  we  have  for  the  augmented  system 

x(q+)  =  x (q)  (103) 

A  ^4  A  A 

u(q  )  *  u  (q)  +  Au  (q)  (104) 

Px(q+)  =  Px(q)  (105) 

Pxu(q+)  -  pxu(q)  (106) 

Pu(q+)  *  Pu(<3)  +  P  A  u^  (107) 

In  order  to  utilize  the  unaugmented  filtering  technique 
we  need  to  put  Eqs.  (103)  -  (107)  into  the  Friedland  form 
(25)  -  (27) .  We  make  use  of  the  reinitialization  equations 
(20)  -  (24)  of  the  unaugmented  filters.  Consequently,  we 
make  the  definitions 

Sq  =  Pxu(,3+>  Pu‘1,q+I  (108» 

Xx(q+)  *  x(q+)  -  Sg  u(q+)  (109) 

Vq+)  -  Vq+)  -  sq  Vq+>  SqT 


(110) 


(Ill) 


u  (q+)  =  u(q+) 

pu  (q+)  =  Pu<q+)  (H2) 


The  initial  conditions  (108)  - 
Friedland  form 


x(q+)  =  x1(q+)  +  S  u(q+) 


u(q+)  =  u(q+) 


(112)  ensure  that  we  have  the 


(113) 

(114) 


P(q+) 


V*+>  +  Sq  V«+>SqT 

[  V*+>SqT 


Sq  V<5+> 

V<>+>  ’ 


(115) 


In  view  of  Eqs.  (94)  -  (98)  and  (103)  -  (107)  we  can 


rewrite  Eqs.  (108)  -  (112)  as  follows 

Sg  =  Su(q;0)  Pu(q)  [Pu(q)  +  P^tq))"1  (116) 

X-^q*)  =  xx(q)  +  Su(q;0)  u(q)  -  Sq[u(q)  +  Au(q)]  (117) 

u(q+)  =  u  (q)  +  Au(q)  (118) 

Px(<3+)  =  V<3>  +  Su(q;0)Pu(q)SuT(q;0) 

-  Sq[Pu(q)  +  PAU(q)]  SgT  (119) 

V<*+>  "  V*>  +  PAu(q) 


(120) 


Note  that 


sq  CPu(q)  +  PiU(q)l  -  Su(q,0)  Pu(q) 

Sq  *„<■»  suT<<3!°>  ’  ?u(q)  SqT 

Eqs.  (121)  and  (122)  are  used  in  showing  that  (q+)  as 
defined  by  Eq.  (119)  is  the  covariance  of  x^ (q+)  as  defined 
by  Eq.  (117) . 

Eqs.  (116)  -  (120)  are  the  equations  for  reinitializing 
the  unaugmented  filters  defined  by  the  equations  in  Tables  5 
and  7.  Equations  (x)  -  (xii)  of  Table  7  are  replaced  with  the 
following: 

Hu(k)  =  H (k)  Su(k;q) 

Su(k+l);q)  =AA(k+l,k)  Su(k;l)  +AB(k+l,k) 


(121) 

(122) 


1 

] 

1 


S  (q;q)  =  S„ 


£*■ 


m 


5.  OPTIMAL  FILTERING  OF  UNAUGMENTED  JUMP  PROCESSES: 
REINITIALIZATION  BEYOND  JUMP 


We  continue  to  address  the  jump  process  described  by  Eqs. 

(1)  -  (3) .  In  this  section  we  make  the  same  assumptions  as  those 
given  in  the  first  paragraph  of.  the  previous  section.  Herein, 
we  develop  the  equations  for  the  optimal  estimates  in  terms  of  the 
unaugmented  estimates  for  the  case  that  we  do  not  reinitialize  the 
unaugmented  filters  at  the  jump  time.  Rather,  we  initialize  at 
some  time  k*  beyond  the  jump  time  q. 

Consider  the  following  conditions  for  the  Kalman-Bucy  filter 
of  the  augmented  system: 

Hj^:  There  is  a  jump  in  control  but  the  filter  is  unaware  that 
the  jump  (10)  has  taken  place  and  it  operates  as  if  the 
jump  at  time  q  is  zero.  The  initial  conditions  immediately 
after  the  jump  are  (126)  and  (127) .  That  is,  it  uses  the 
same  estimates  immediately  after  the  jump  as  it  had  just 
before  the  jump. 

There  is  a  jump  in  control,  the  jump  (10)  is  known  to  the 
filter  and  the  jump  information  is  made  use  of  in  the  filter. 
The  initial  conditions  immediately  after  the  jump  are 
(128)  and  (129). 
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(126) 


Xx(q+) 


Px(q+) 


X2(q+) 


P2(q+) 


=  X  (q) 

=  P(q) 

=  X  (q)  +  a  Xc 

=  P  (q) 


(127) 

(128) 
(129) 


It  is  shown  in  [1]  that  after  the  jump  the  optimal  estimates 
X(k)  and  P (k)  are  given  by 


X  (k)  =  Xx(k)  +  AX(k) 


P  (k)  =  Px(k)  +  aPOO 


(130) 


(131) 


where  AX(k)  and  AP(k)  are  the  output  of  a  Kalman-Bucy  filter 
having  the  initial  conditions 


A  X (q)  =  AX 
A  P(q)  =  I 


q 

0  0 
0  PAU(^ 


(132) 

(133) 


Therein,  the  A-state  AX(k)  is  defined  as 


A  X (k)  *  X2(k)  -  X1 (k) 


(134) 


It  satisfies  the  A-state  equation 


A  X(k)  =A$  (k,k-l)  A  X(k-l) 


(135) 


where 


A*  (k,k-l)  -  [I  -  Kx(k)  Ha(k)]»  (k,k-l) 


(136) 


**w 


The  matrix  Ha  is  defined  by  Eq.  (12) .  The  Kalman  gain  is 
that  which  is  given  by  the  filter  operating  under  Condition 
From  Eqs.  (80)  and  (81)  we  see  that  can  be  expressed  in  terms 
of  the  unaugmented  gains  Kx  and  K^: 


Kx(k) 


Klx(k) 

(  1X  ) 

Kiu(k) 


(137) 


where 


Klx(k)  =  Kx(k)  +  Su(k;0)  Klu(k)  (138) 

Klu(k)  -  Ku(k)[I  -  H (k)  Kx(k)]  (139) 


The  augmented  state  AX  in  terms  of  the  unaugmented  states 
is  given  by 


A*  00 

A  X (k)  =  [  ]  (140) 

Au(k) 


We  have  the  initial  conditions 

A  x (q)  =  0  (141) 

A  u  (q)  =AUg 


(142) 


We  define  the  nxp  matrix  S  and  the  pxp  matrix  S.  as  follows 

*  A  VI 

Sx(k+l;q)  =^A1(k+l,k)  Sx(k;q)  H-AB.^k+l.k)  SAu(k;q)  (143) 

SAu(k+1?q)  =AA2(k+l,k)  Sx(k;q)  +&B2(k+l,k)  SAu(k;q)  (144) 

Sx(q?q)  =  0  (145) 

SAU(q;q)  =  1  (146) 

where 

AA^k^-l)  =  [I  -  Kx(k)H(k)  -  Su(k;0)Klu(k)H(k)  ]  A(krk-1)  (147) 
A  B1(k,k-1)  =  [I  -  Kx(k)H(k)  -  Su(k;0)  Klu(k)H(k)]  B  (k,k-l)  (148) 
A  A2(k,k-1)  =  -Klu(k)  H (k)  A(k,k-1)  (149) 

A  B2 (kfk-l)  -  [I  -  Klu(k)  H (k)  B (k,k-l) ]  (150) 

Using  Eqs.  (135)  -  (150)  one  can  verify  that 

Ax(k)  =  Sx(k;q)AUg  (151) 

Au(k)  =  SAU(k;q)Auq  (152) 

The  measurement  equation  for  AX(k)  is  shown  in  [1]  to  be 
Az(k)  =  Ha(k)  AX  (k)  +  Au(k)  (153) 

where 

A  z  (k)  -  z  (k)  -  Ha(k)  X.^  (k)  (154) 

a 

Au  (k)  -  z(k)  -  H  (k)  X.  (k) 

cl  4 


(155) 


Note  that  Au  is  the  a  posteriori  measurement  residual  under 
Condition  H2.  It  follows  that  Au  00  is  a  zero  mean  white  Gaussian 
sequence  with  covariance  defined  by 

E{  Au  (k)  AuT(j)  }  =  ARW  6  kj  (156) 

where 

A  R (k)  «  R(k)  V2_1(k)  R(k)  (157) 

The  matrix  V2 (k)  is  the  predicted  measurement  residual  covariance 
under  Condition  H2.  From  Eq.  (87)  we  see  that  V2  can  be  expressed 
as  a  function  of  and  Vu: 

v2  (k)  =  Vx(k)R-1(k)  Vu(k)  R“1(k)  Vx(k,  (158) 

Consequently,  AR(k)  is  given  by 

A  R(k)  =  R(k)  V  "1(k)  R(k)  V  “1(k)  R(k)  V  "1  (k)  R(k)  (159) 

X  U  X 

Using  Eqs.  (82)  -  (83)  we  see  that  (k)  is  given  by 
x1  (k)  +  S  (k;  0)  u  (k) 

X.  (k)  =  (  1  «.  u  ]  (160) 

1  u(k) 

Consequently,  Eq.  (154)  can  be  rewritten  as 

Az(k)  *  z  (k)  -  H(k)  [x1  (k)  +  Su(k;0)u(k)]  (161) 
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In  view  of  Eqs.  (12)  and  (140)  we  can  rewrite  (153)  as 

Az(k)  =  H (k)  Ax(k)  +  Au  (k)  (162) 

Substituting  (151)  into  (162)  gives  the  measurement  equation 
for  Au 

q 

A z (k)  =  H (k)  Sx(k;q)  Aug(k)  +  Au  (k)  (163) 

where  Aug(k)  satisfies  the  constant  state  equation 

AU  (k)  =  Au  (k-1)  =  au  (164) 

H  4  4 

The  filtering  equations  for  estimating  au^  are  given  in  Table  8. 

The  optimal  estimates  X(k)  and  P (k)  are  given  by  Eqs.  (130) 
and  (131) 


X(k)  =  xx(k) 

+  AX(k) 

(165) 

P(k)  =  Px(k) 

+  A  P  (k) 

(166) 

where 

A 

/s  Ax(k) 

AX(k)  =  [A  ]  (167) 

AU  (x) 


Ax(k)  =  Sx(k;q)  Aug(k) 


(168) 


(170) 


Sx(k;q)  P  u(k)  SxT(k;q)  Sx(k;q)PAu(k)  SAuT(k;q) 
4P(k)  =  [  ] 

Wk!9,\  u  (k>  S*T  (k  ’  s4  „  »<  q) \  „  <*>  S4  UT  (k  I  q) 


,  (k)  = 

,plx<k> 

l  m 

Plxu(k>] 

(171) 

1 

*iiu  w 

Plu(k> 

lx(k) 

-  Px(k>  + 

S  (k;  0)  P  (k)  S  T  (k;  0) 
u  u  u 

(172) 

lxu<k) 

=  Su(k;0) 

p  (k) 
u 

(173) 

lu<k) 

=  Pu(k) 

(174) 

Using  Eqs. (160) ,  (165)  -  (174)  we  have  the  optimal  estimates 

x(k)  =  xx(k)  +  Su  (k;  0)  u  (k)  +  Sx(k;q)  A~uq  (k)  (175) 

u  (k)  =  u  (k)  +  SAu(k;q)  Auq(k)  (176) 

Px{k)  *  Px(k)  +  Su(k;0)Pu(k)  SuT(k;0)  +Sx(k;q) 

PAu(k)  SxT(k;q)  (177) 

pxu(k)  “  Su(k?0)Pu(k)  +  sx(k?q)  PAu(k)  SAuT(k?q)  (178) 

Vk)  "  Pu(k)  +  SAu(k;q)  PAu(k)  SAuT(k'q)  (179) 

Eqs.  (175)  -  (179)  give  the  optimal  estimates  in  terms  of 
the  unaugmented  filter  estimates  described  by  the  filters  of 
Tables  5,  7  and  8. 
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At  some  time  k*  beyond  the  jump  we  desire  to  reinitialize 
the  filters  of  Tables  5  and  7.  This  is  more  efficient  than 
operating  the  three  filters  of  Tables  5,  7  and  8. 


We  make  the  following  definitions  with  k=k* : 


Sk*  -  Pxu<k)  Pu  <k) 


(180) 


x1(k+)  =  x(k)  -  Sk*  u (k) 


(181) 


?x(k+)  -  Px(k)  -  8k.  P„(k)  Sk,T 


(182) 


u(kT)  =  u  (k) 


(183) 


P  (k  )  =  P  (k) 
u  u 


(184) 


The  argument  k  refers  to  values  just  after  the  reinitialization 
at  k=k*.  Eqs.  (180)  -  (184)  are  the  equations  for  reinitializing 
the  unaugmented  filters  of  Tables  5  and  7.  Equations  (x)  -  (xii) 
of  Table  7  are  replaced  with  the  following  (the  time  k*  represents 
the  time  of  reinitialization) : 


Hu(k)  =  H (k)  Su(k;k*),  k>k* 


(185) 


Su(k+l;k*)  =  AA(k+l,k)  Su(k;k*)  +AB(k+l,k),  k>k*  (186) 


Su(k*;k*)  =  Sk* 


(187) 


Using  the  expression  derived  in  [1] 


K(k)  -  Kjtk)  +  AK(k)  [I  -  Ha(k)  K1(k)] 


(188) 


i 


The  optimal  Kalman  gain  K (k)  is  given  by 


Kx(k)  =  Klx(k)  +AKx(k)  11  "  H(k)  Klx(k)]  (189) 

Ku(k)  =  Klu00  +  AKu(k)  [I  -  H  (k)  Klx  (k)  ]  (190) 

where 

Klx(k)  =^x(k)  +  Su(k;0)  Klu(k)  (191) 

Klu(k)  "  \{k)  11  ~  H(k)  ^x(k)]  (192) 

AK  (k)  -  S  (k; q)  K  <k)  (193) 

X  X  &  u 

AKu(k)  =  SAU(k;q)  \u(k)  (194) 


Eqs.  (193)  and  (194)  follow  from  Eq.  (vi)  of  Table  8  and 
Eqs.  (151)  -  (152). 

one  may  note  that 

[I  -  KxH]  =  [I  -  aKxH]  [I  -  Su  KuH]  [I  -  KxH]  (195) 

The  predicted  measurement  residual  covariance  V  satisfies 
V(k)  *Vx(k)  R_1  (k)  VAu(k)  R-1  (k)  V1(k)  (196) 

where 

V1 (k)  «  Vx(k)  R-1 (k)  Vu(k)  R"1 (k)  Vx(k) 


(197) 


TABLE  8 


FILTERING  EQUATIONS  FOR  ESTIMATING  Au 

<3 


Auq(k+l|k)  ■  Auq(k)  (i) 

PAu(k+llk)  =  Wk>  (ii) 

YAu<k)  =Az(k)  -  I^u(k)  Auq(k|k-1)  (iii) 

V<k>  '  «Au<k>  tAu(klk-1l  HAuT'k>  +  Riu(k)  (iv) 

>,k)  -5Su«kik-1»  vT(k)  V1(k>  <v» 

A~uq(k)  -A~uq(k|k-1)  +  Ktu(k)  Yiu(k)  (Vi) 

Piu<k»  *  tl  -  Kiu(k)  H4u(k)]  P4u(k|k-i)  (vii) 

where 

A 

Aug(q)  =Aug  (viii) 

PAu(q)  =  PAu(q)  <ix> 

HAu(k)  =  H(k)  sx(k?q)  (x) 

Sx(q;q)  =  0  (xi) 

sAU(q;q)  *  i  (xii) 

Sx(k+l;q)  ®  AAj  (k+1 ,k)  Sx(k;q)  +  AB1<k+l,k)  SAu(k;q)  (xiii) 

SAU(k+1;q)  =AA2(k+l,k)  Sx(k;q)  +  AB2(k+l,k)  SAu(k;q)  (xiv) 

AA1(k,k-l)  -  [I  -  Kx(k)H(k)  -  Su(k;0)Klu(k)H(k)]A(k,k-l)  (xv) 

AB1(kfk-l)  *  [I  -  Kx(k)H(k)  -  Su(k;0)Klu(k)H(k)]B(k,k-l)  (xvi) 

A A2 (k,k-l)  *  -Klu(k)H(k)A(k,k-l)  (xvii) 

AB2(k,k-l)  =  [I  -  Klu(k)H(k)B(k,k-l)]  (xviii) 

Klu(k)  *  Vk)  [I  -  H (k)  Kx  Ck)  ]  (xix) 

RAU(k)  “  RW  Vx"1(k)R(k,V1(k)R(k,V1(k)R(k)  <xx) 

Az(k)  -  z(k)  -  H  (k)  [x1  (k)  +  Su(k;0)u(k)J  (xxi) 
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6.  DETECTION  AND  ESTIMATION  OF  JUMP  USING  THE  GLR  APPROACH: 
BANK  OF  A -FILTERS 


We  consider  the  employment  of  a  bank  of  Kalman-Bucy  constant 

A -state  filters  for  detecting  and  estimating  the  jump  Au  .  The 

jump  AUg  and  the  jump  time  q  are  unknowns.  We  consider  a  moving 

window  of  length  M.  That  is,  at  each  j,  k-M^j<k  we  employ  the 

constant  A -state  filter  defined  by  the  equations  of  Table  8.  Let 

j  be  a  candidate  jump  time  and  let  k  be  the  current  observation 

time.  The  filtering  equations  in  Table  8  are  used  to  obtain  the 

estimate  a u . (k)  and  P  .  (k) .  The  filter  is  started  when  the 
3  A  u/  J 

current  observation  time  is  j.  It  uses  the  initial  conditions 


AUj  (j)  -  Auq 

(198) 

V.j'3'  *  v<ql 

(199) 

Sx(j;j)  -  0 

(200) 

V<3’3>  *  1 

(201) 

At  each  new  observation  k  the  matrix  Sx(k;j)  is  computed  using 

Eqs.  (xiii)  -  (xix)  of  Table  8.  Eqs.  (i)  -  (vii)  are  then  used 

to  compute  a u. (k)  and  P.  ,  .  (k) .  The  following  are  also  computed 

3  au,  3 

d j  (k)  =  dj  (k-1)  +  Hau,jT<k)  RAu”1(k)  Az(k)  (202) 


*  d/  (k)  AUj  (k) 


(203) 
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(204) 


The  vector  d^  has  the  initial  condition 
d.(j)  =  0 

The  above  computations  are  carried  out  for  each  candidate 
jump  time  j,  k-M£j<k.  A  jump  is  detected  at  time  k  for  the 
jump  time  q,  k-M<q<k,  if 

£  (k)  >  2  £n(n) 

'■d 

£  (k)  ■  Max  {£j  (k)  :  k-M<j<k  }  (205) 

where  the  value  n  is  chosen  to  provide  a  reasonable  tradeoff 
between  false  and  missed  alarms.  The  above  is  a  generalized 
likelihood  ratio  (GLR)  algorithm  for  detecting  and  estimating 
the  jump, [1]  and  [16].  In  applying  the  filter  described  by  the 
equations  of  Table  8  one  should  sequentially  update  the  correlated 
subblocks  of  components  of  the  measurement  vector  as  discussed 
in  [17]  -  [20]. 

After  a  jump  has  been  detected  and  estimated  we  use  Eqs.  (175) 
(187)  to  reinitialize  the  filters  of  Tables  5  and  7.  The  above 
GLR  algorithm  is  used  to  detect  and  estimate  the  next  jump. 
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7. 


SUMMARY  OF  DERIVED  EXPRESSIONS 


The  optimum  estimates  x  of  the  state  and  u  of  the  control 
satisfy  the  expressions 

A  ^  M 

x  =  x  +  S  u  +  S  A  u 
u  x 

A  M 

u  =  u  +  S.„  Au 
Au 


where  x,  u  and  au  are  the  output  of  a  tri-system  of 
unaugmented  Kalman-Bucy  filters  with  covariances  Px,  Pu  and 
i?Au,  respectively. 


The  matrices  S  .  S„  and  S.  ,  satisfy 

U  X  A  u 

Stl(k+1)  =  A  v  A  S(k)  +  A  B 

u  XU  x 

SX(k+1)  =  *uA  Sx(k)  +  au  B  SAU(k) 

S.„(k+1)  =  A...  A  S„(k)  +  Aa„  B  Sa  ..  (k)  +  S.lk) 


where 

A  =  I  -  K  H 

X  X 

(214)  ij 

;j 

A  =  [I  -  S  K  H] A 

U  U  U  X 

(215)  j 

! 

A.  =  -K  H  A 

Au  u  x 

i 

(216)  ! 

The  initial  conditions  of  Su,  and  S^u  are 

S  (0)  =  P  (0)  P  ,_1  (0) 
u  XU  u 

(217)  i 

:  \ 

;  -j 

Sx(q)  =  0 

(218) 

t  . 

Siu«"  -  1 

(219) 

where  q  is  the  jump  time,  Pu(0)  is  the  initial  covariance  of 

u  and  P  (0)  is  the  initial  cross-covariance  of  x  and  u. 

XU 

The  optimal  Kalman  gains  satisfy 

Kx  -  \  *  tSu  *u  +  Sx  *4u(I  -  H  su  V1  11  -  H  V 

(220) 

Ku  '  [*u  +  s*u  hn  f1  -  H  SU  V1  11  -  H  **> 

(221) 

The  predicted  measurement  residual  covariance  satisfies 

v  -  V1  R'1  V  R'1  V1 

(222) 
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where 


V,  =  V  R_1  V  R-1  V 
lx  u  x 


(223) 


and  where  V  V  and  V.  are  the  predicted  measurement  residual 
x  '  Au 

covariances  of  the  x-,  the  u-  and  the  Au  filters,  respectively. 


After  reinitialization,  the  optimum  estimates  satisfy 
Friedland's  expressions  [21] 


x  =  x  +  Suf  u' 


(224) 

(225) 


where  the  prime  denotes  the  output  of  the  x-  and  the  u-filters 
after  reinitialization.  The  reinitialized  values  of  Su,  x, 

Px,  u  and  Pu  satisfy  the  following  expressions  at  reinitialization: 


V 

-  <Su  \  *  Sx  s4uT)  ‘;u  + 

SAU 

P  s  T]_1 

PAu  SAu  J 

(226) 

X' 

^  w 

=  x  +  Su  u  +  Sx  AU  -  Su'  [u  + 

SAU 

A  u] 

(227) 

p  ' 

X 

~  ~  *r  ~  T 

=P  +S  P  S+S  PA„  S„ 
x  u  u  u  x  Au  x 

-  V  [Pu  +  SAU  PAu  SAU  ]Su’T 


u'  =  u  +  SAU  AU 


V  =  Pu  +  SAu  PAu  SAu 


(228) 

(229) 

(230) 


The  equations  of  the  x-,  the  u-,  and  the  Au-filters  are 
given  in  Tables  5,  7  and  8,  respectively. 


8 .  CONCLUSIONS 


We  have  developed  a  Friedland-like  filtering  technique  for 
estimating  the  state  x  of  a  discrete  linear  stochastic  process 
which  depends  on  a  piecewise  constant  control  vector  u.  It  is 
composed  of  three  unaugmented  Kalman-Bucy  filters.  In  the  first 
filter  the  estimate  x  of  the  state  is  computed  as  if  there  were 
no  control  present  and  no  jump  in  control  present.  This  estimate 
is  then  corrected  to  account  for  the  control  and  for  the  jump  in 
control.  In  the  second  filter  the  estimate  u  of  the  control  is 
computed  as  if  there  were  no  jump  in  control  present.  This  estimate 
is  corrected  to  account  for  the  jump  in  control.  In  the  third 
filter  the  optimum  estimate  Au  of  the  jump  in  control  is  computed. 

A 

The  optimum  estimate  x  is  a  vector  sum  of  the  three  estimates 
x,  u  and  Au.  The  coefficient  of  u  in  the  sum  is  a  matrix  having 
dependence  on  the  gain  of  the  x-filter.  The  coefficient  of  Au 
in  the  sum  is  a  matrix  that  depends  on  the  gains  of  the  x-  and  the 
u-filters. 

A 

The  optimum  estimate  u  is  a  vector  sum  of  the  two  estimates 
u  and.Au.  The  coefficient  of  A u  is  a  function  of  the  gains  of 

AM  Aim 

the  x-  and  the  u-filters. 
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The  x-filter  processes  the  measurement  z.  The  u-filter 
processes  as  its  measurement  the  a  posteriori  measurement 
residual  z-Hx  of  the  x-filter.  The  Au-f ilter  processes  the  a  posterior 
measurement  residual  z  -  Hx  -  H  Suu  of  the  u-filter  in  which  Su 
depends  on  the  gain  of  the  x-filter. 

A  procedure  has  been  developed  for  reinitializing  the  x- 
and  the  u-filters  after  a  jump  has  been  detected  so  that  the 

A  A 

optimum  estimates  x  and  u  are  functions  only  of  the  output  of 
those  filters  and,  as  a  result,  satisfy  Friedland's  expressions 
[21].  The  reinitialization  procedure  permits  the  treatment  of 
multiple  jumps. 

We  have  presented  a  GLR  algorithm  for  detecting  the  jump 

»v 

time  q.  It  uses  the  x-  and  u-filters  and  a  bank  of  Au-filters. 

The  algorithm  reinitializes  the  x-  and  u-filters  after  a  jump  has 
been  detected.  This  GLR  algorithm  avoids  numerical  inaccuracies 
introduced  by  computations  with  large  vectors  and  matrices  due 
to  augmenting  the  state  vector  of  the  original  system  with  the 
control  vector.  The  algorithm  has  particular  application  to 
problems  involving  a  large  number  of  state  and/or  jump  variables. 
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